Considering the implementation research-to-practice gap: An experimental evaluation of intervention-general methods for assessing and supporting intervention fidelity through coaching.

Implementation support through coaching-such as with embedded fidelity assessment, performance feedback, modeling, and alliance building-has been empirically supported as a way to increase and sustain interventionists' fidelity levels. However, education research consistently shows that practitioners struggle to monitor and improve interventionists' fidelity using implementation support strategies. One explanation for this type of implementation research-to-practice gap is that evidence-based coaching strategies have significant limitations with respect to their usability, feasibility, and adaptability. This study is the first to experimentally evaluate an evidence-based set of adaptable materials and procedures designed to assess and support the intervention fidelity of school-based interventions. Using a randomized multiple-baseline-across-participants design, we examined the extent to which these materials and procedures would influence intervention adherence and quality of an evidence-based reading intervention. Across all nine interventionist participants, data revealed that the implementation strategies meaningfully improved intervention adherence and quality, and high levels of intervention fidelity maintained 1 month after removing the support procedures. Findings are discussed with respect to how these materials and procedures address a critical need within school-based research and practice as well as how they may help to inform and address the implementation research-to-practice gap in education.

Translation and cultural adaptation of the HELPS Reading Fluency Program into Brazilian Portuguese: A report of systematic adaptation processes and initial evidence of efficacy.

Introduction: Across multiples languages, research demonstrates the important relationship between reading fluency and comprehension. Put simply, a fluent reader has greater attention and memory resources to use higher-order functions in reading, resulting in better comprehension of text. Some reading fluency interventions have shown positive results in improving students' text reading fluency and comprehension; however, this research has predominantly been conducted with English-speaking students. For instance, until this report, a comprehensive search revealed only one prior study that evaluated an intervention strategy designed to improve students' reading fluency in Brazilian Portuguese and no prior studies evaluated an intervention program with that population of students. Methods: The main goals of this two-part project were to (a) systematically translate, culturally adapt, and pilot test the Helping Early Literacy with Practice Strategies (HELPS) reading fluency program for use in Brazilian Portuguese (referred to as, HELPS-PB); and (b) conduct a preliminary quasi-experimental study of the HELPS-PB program with 23 students in grades 3 to 5 who needed a reading fluency intervention. Results and Discussion: This report documents the processes and successful adaptation of existing English- and Spanish-versions of HELPS into a new HELPS-PB program. It also offers preliminary evidence showing that students receiving HELPS-PB significantly improved their text reading fluency comparted to students in a control group. Implications for research, practice, and the adaptation of reading fluency programs into other languages are discussed.

Three Alternatives for Graphing Behavioral Data: A Comparison of Usability and Acceptability.

Making treatment decisions based upon graphed data is important in helping professions. A small amount of research has compared usability between equal-interval and semi-log graphs, but no prior studies have compared different types of semi-log graphs. Using a randomized, cross-over, experimental design with 72 participants, this study examined the relative usability and acceptability of three types of graphs: Regular (equal-interval), Standard Celeration Chart (SCC; semi-log), and Standard Behavior Graph (SBG; semi-log). All participants used each graph across three usability tasks (Plotting Data, Writing Values, and Interpreting Trends). For the Plotting and Writing tasks, the equal-interval graph produced the greatest rate of correct responses. However, for the Interpreting task the SBG produced the greatest rate of corrects, while the equal-interval graph produced the smallest rate. User acceptability mainly favored the equal-interval and SBG graphs. Study findings and implications are discussed with respect to graph usability and acceptability during day-to-day practice.

Parent and Teacher Ratings of Behavioral Executive Functioning for Students With Dyslexia.

Research exploring behavioral ratings of executive functioning (EF) for children and adolescents with dyslexia is scarce, which limits researchers, clinicians, educators, and parents from understanding and best supporting these students at home and/or school. Using the Behavior Rating Inventory of Executive Function, Second Edition (BRIEF-2) rating scale to measure participants' EF behaviors in home and school settings, a primary objective of this study was to examine the EF of Spanish children and adolescents with dyslexia (n = 78) and to compare their EF with typically developing (TD) peers (n = 82). The study also sought to examine agreements and disagreements among teacher and parent raters. One key finding was that children and adolescents with dyslexia were rated by both parents and teachers as having more frequent cognitive, behavioral, and emotional EF difficulties in home and school compared with TD peers. However, teachers often reported greater severity of impairments than parents did across several EF domains, potentially suggesting a differential pattern of EF difficulties between home and school. Results are discussed in relation to multi-informant assessment practices for EF behaviors (e.g., there may be differential patterns of EF difficulties between home and school) and how the findings have implications for supporting children and adolescents with dyslexia.

Evaluating Tau-U With Oral Reading Fluency Data and the Impact of Measurement Error.

Recently, researchers have argued that using quantitative effect sizes in single-case design (SCD) research may facilitate the identification evidence-based practices. Indices to quantify nonoverlap are among the most common methods for quantifying treatment effects in SCD research. Tau-U represents a family of effect size indices that were developed to address criticisms of previously developed measures of nonoverlap. However, more research is necessary to determine the extent to which Tau-U successfully addresses proposed limitations of other nonoverlap methods. This study evaluated Tau-U effect sizes, derived from multiple-baseline designs, where researchers used curriculum-based measures of reading (CBM-R) to measure reading fluency. Specifically, we evaluated the distribution of the summary Tau-U statistic when applied to a large set of CBM-R data and assessed how the variability inherent in CBM-R data may influence the obtained Tau-U values. Findings suggest that the summary Tau-U statistic may be susceptible to ceiling effects. Moreover, the results provide initial evidence that error inherent in CBM-R scores may have a small but meaningful influence on the obtained effect sizes. Implications and recommendations for research and practice are discussed.

Geographically representative scholarship and internationalization in school and educational psychology: A bibliometric analysis of eight journals from 2002-2016.

Although the discipline of school and educational psychology is arguably international (e.g., relevant research and practice is evident in more than 80 countries), there has been limited research examining the international scholarship published in school and educational psychology journals. Such an assessment is important because it provides one important metric for better understanding the field's level of internationalization. The purpose of this study was to evaluate every article (N = 4456) published from 2002 to 2016 across eight school and educational psychology journals that publish international scholarship. Each article's authorship and participant data were coded and reported in terms of respective country and geographical region. Research questions examined, for example, how the published scholarship aligns with international employment data for school psychologists and whether particular journals published a geographically wider breadth of articles. Overall findings indicated that although the field of school psychology is present in more than 80 countries, the overall scholarship in the reviewed journals predominantly features participants living in, and authors working in, North America or Western Europe. However, one journal (School Psychology International) published relatively more articles with participants from outside of these geographic regions. Also, journals affiliated with a national professional organization largely differed in their percentage of "within-nation" publications (e.g., articles with participants living in the same nation that sponsors the respective journal). Explanations of the data are discussed and several recommendations are made that, if followed, could improve the internationalization and geographical representation of scholarship in school and educational psychology.

Single-case effect size calculation: comparing regression and non-parametric approaches across previously published reading intervention data sets.

Growing from demands for accountability and research-based practice in the field of education, there is recent focus on developing standards for the implementation and analysis of single-case designs. Effect size methods for single-case designs provide a useful way to discuss treatment magnitude in the context of individual intervention. Although a standard effect size methodology does not yet exist within single-case research, panel experts recently recommended pairing regression and non-parametric approaches when analyzing effect size data. This study compared two single-case effect size methods: the regression-based, Allison-MT method and the newer, non-parametric, Tau-U method. Using previously published research that measured the Words read Correct per Minute (WCPM) variable, these two methods were examined by comparing differences in overall effect size scores and rankings of intervention effect. Results indicated that the regression method produced significantly larger effect sizes than the non-parametric method, but the rankings of the effect size scores had a strong, positive relation. Implications of these findings for research and practice are discussed.